You can delete a site on the Site Management screen using the Waste Bin icon.
Once a site is deleted it cannot be recovered.
A site can be backed up for restoring to a new SQL database, see System Configuration > Global Settings > Backup.